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Abstract — A solution is presented for the asymptotic growth 
rate of the AWGN-pseudoweight distribution of regular low- 
density parity-check (LDPC) code ensembles for a selected graph 
cover degree M > 1. The evaluation of the growth rate requires 
solution of a system of 2AI + 1 nonlinear equations in 2M + 1 
unknowns. Simulation results for the pseudoweight distribution 
of two regular LDPC code ensembles are presented for graph 
covers of low degree. 

I. Introduction 

In classical coding theory, the weight distribution of a code 
is a useful tool for measuring a linear code's performance 
under maximum likelihood (ML) decoding. For codes de- 
coded using modern high-performance suboptimal decoding 
algorithms such as sum-product (SP) or linear-programming 
(LP) decoding, the pseudoweight is the appropriate analog of 
the codeword weight. There are different definitions of pseu- 
doweight for different channels; one of primary importance is 
the additive white Gaussian noise (AWGN) pseudoweight. The 
pseudoweight distribution considers all codewords in all codes 
derived from finite covers of the Tanner graph, which compete 
with the codewords to be the best SP decoding solution. The 
set of pseudocodewords has a succinct characterization in 
terms of the so-called fundamental polytope or equivalently, 
the fundamental cone 0, flU, 0. Also, pseudocodewords 
arising from finite covers of the Tanner graph were shown to be 
equivalent to those responsible for failure of LP decoding Q, 
0. While much of the existing work in this area is concerned 
with performance characterization of particular codes, the 
performance of ensembles of low-density parity-check (LDPC) 
codes [l] is also of interest. 

In [9 1, the growth rate of the weight distribution of irregular 
LDPC codes was derived, and a numerical technique was 
presented for its approximate evaluation. It was shown in ||5] 
Corollary 50] that (j, fc)-regular ensembles with j > 3 have 
a ratio of minimum AWGN-pseudoweight to block length n 
which decreases to zero asymptotically as n — > oo. Apart 
from this result, to the author's knowledge no ensemble results 
exist in the literature concerning AWGN-pseudoweight. In 
this paper, we make a first step in this direction. We define 
the degree-A/ pseudoweight enumerating function of a linear 
block code, and use this concept to find an expression for 
the growth rate of the AWGN-pseudoweight of regular LDPC 
code ensembles. We also present simulation results for the 
(3, 6) -regular and (4, 8)-regular LDPC code ensembles. 



II. Preliminaries and Notation 

We begin by providing some general settings and defini- 
tions. For u = (iii U2 •" um), we denote the multinomial 
coefficient by 

'k\ _ f k \ k\ 
,uj \ M i u 2 ■■■ u M , 



( fc -Eril M r)!Il, A il M r! 



For a. = (a.\ a 2 ••• «m) G K M with a r > for each r = 
1,2, ••• , M and X^rli a r < 1> we denote the multivariate 
entropy function by 
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(1) 

All logarithms in the paper are to the base e. 

Let C be a linear block code of length n over the binary 
field F2, defined by 



(2) 



where H = {Hj,i) is an m x n matrix over F2 called the parity- 
check matrix of the code C. Also denote X = {1, 2, • • • , n}, 
J = {1, 2, • • • , to} and for each j S J 

lj = {i G I : H jti = 1} . 

The Tanner graph of a linear block code C over F2 with 
parity-check matrix H is an equivalent characterization of 
H. The Tanner graph Q = (V, £) has vertex set V = 
{«i,U2,--' , u n } U {i>i,V2) - " > w m}, and there is an edge 
between Ui and Vj if and only if Hj i = 1. We denote by 
Af(v) the set of neighbors of a vertex v G V. 

We next define what is meant by a finite cover of a Tanner 
graph. 

Definition 1: ((4)) A graph Q = (V, £) is a finite cover of 
the Tanner graph Q = (V, £ ) if there exists a mapping II : 
V — ► V which is a graph homomorphism (IT takes adjacent 
vertices of Q to adjacent vertices of Q), such that for every 
vertex v G V and every v G II -1 (v), the neighborhood Af(v) 
of v is mapped bijectively to Af(v). 

Definition 2: (0) A cover of the graph Q is said to have 
degree M, where M is a positive integer, if |IT _1 (u)| = M 
for every vertex v G V. We refer to such a cover graph as an 
M-cover of Q. 



Let Q — (V,£) be an Af -cover of the Tanner graph Q = 
(V,£) representing the code C with parity-check matrix H. 
The vertices in the set n -1 (itj) are called copies of Ui and 
are denoted {Ui t %, Ui t 2, ■ ■ • , u^m}, where i 6 I, Similarly, 
the vertices in the set n _1 (wj) are called copies of Vj and are 
denoted {Vj,i,Vj t 2, ■•• , «7,m}> where j G ,7. 

Less formally, given a code C with parity check matrix H 
and corresponding Tanner graph Q, an M -cover of Q is a graph 
whose vertex set consists of M copies of each vertex u, and 
M copies of each vertex Vj, such that for each j G J7\ i G X,-, 
the A/ copies of u - L and the M copies of Vj are connected in 
an arbitrary one-to-one fashion. 

For any M > 1, an M-cover codeword is a labelling of 
vertices of the A/-cover graph with values from F 2 such that 
all parity checks are satisfied. We denote the label of r by 
Pi r for each i G 1, r = 1, 2, • • • , M, and we may then write 
the M-cover codeword in vector form as 

P = (P1,1,P1,2, ' ' ■ ,Pl,M,P2,l,P2,2, 

'•• >P2,M>"' ,Pn,l,Pn,2, ' ' ' )P»,m) • 

It is easily seen that p belongs to a linear code C of length 
Mn over F2, defined by an Mm x Mn parity-check matrix 
H. To construct H, for 1 < i* , j* < M and i el, j £ J, we 

let i' = (i - 1)M + i*,f = {j - 1)M + j*, and 

1 if Ui t i* G N(vj,j* ) 
otherwise. 



Hj>,i> - 



It may be seen that Q is the Tanner graph of the code C 
corresponding to the parity-check matrix H. 

We next define the concept of pseudocodeword as follows. 

Definition 3: Let C be a linear code of length n with parity- 
check matrix H. For any positive integer M, a vector z = 
(zi z 2 ■ ■ ■ z n ) of length n with nonnegative integer entries is 
said to be a degree-M pseudocodeword of the code C if and 
only if there exists an M -cover codeword p with 



|{re{l,2,...,M} : Pi 



1}| 



for all i El. 



Definition 4: The pseudoweight of a degree- Af pseu- 
docodeword 2 of the code C is equal to the vector u = 
(ui u 2 ■ ■ ■ ttjf), where z has u r entries equal to r for each 
r = l,2,---,M. 

Note that the pseudoweight as defined here corresponds to 
the "type" of a pseudocodeword in the notation of [6|. Note 
also that this notion of pseudoweight is applicable to different 
channels such as the additive white Gaussian noise (AWGN) 
channel, binary symmetric channel (BSC) or binary erasure 
channel (BEC). The AWGN-pseudoweight of a pseudocode- 
word z of length n is defined by (2) 



w{z) 



(Eiei z *y 



(3) 



and its BSC-pseudoweight and BEC-pseudoweight are defined 
in |f3l (see also [5, Section 6]). 



Definition 5 (Sdlj): The fundamental cone /C(H) of the m x 
n parity-check matrix H is equal to the set of vectors v = 
(y\V2 ■ ■ ■ f n ) G M" such that v. L > for all i G X, and 

1^ > Vj <E J,i Elj . 

In 0, it was shown that if C is a binary linear code with an 
m x n parity-check matrix H, then a length-n integer vector 
z is a pseudocodeworcQ of H if and only if z G /C(H) and 



zH T = (mod 2) 



(4) 



where /C(H) denotes the fundamental cone of H, and the 
matrix H in (01 is interpreted over the integers. 

We next define the concept of pseudoweight enumerating 
function of a block code. 

Definition 6: The degree- Af pseudoweight enumerating 
function (PWEF) of a block code C of length n is equal to 



(M) x u lx u 2 



' M 



where x — [x\ X2 ■ • ■ xm), u = (u>i 112 • ■ • mm) an d Bu' 1 ' 1 
denotes the number of degree-M pseudocodeword^ of the 
code with pseudoweight u. 

Proposition 1: The degree- M PWEF of the single parity- 
check (SPC) code of length k is 



P (M \x) 



Q {M \x) 



where P^ M \x) 4 1 + Y%Li*r, Q {M) (x) 
T,rLi(- 1 Y x r, T^(x) = 0, and for M > 1 

T( M \x)=T( M -V(x) 



T {M \x) 
(5) 



■ x M 



E 



1 V\ V2 



VM-1 



U M-1 



(6) 

where the set U M ~ X in © is the set of integer vectors v = 
(vi V2 ■■ ■ vm-i) satisfying v r > for all r — 1, 2, • ■ • , M — 



Srli 1 rw r < M and where ^ 



dd 



M is even. 



Proof: In this case H is a length-fc row vector of ones, 
so we have 

S W f (£) 

u 1 otherwise, 

where (using Definition |5j <S is the set of integer vectors u 
which satisfy 
(5-1) 



u r > Vr = 1,2,- 



M 

, M ; u r 

r=l 



< k, (7) 



'Note that the object we call a "pseudocodeword" was called an "unsealed 
pseudocodeword" in (4)- 

2 Note that this count does not consider the multiplicity of M-cover 
codewords corresponding to a particular pseudocodeword. 
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(S-2) 

u r is even, and 

r odd 

(5-3) If there exists c e {1, 2, • • • ,M} with m c 
u r = for c < r < M, then 

c-1 

c < ru r . 

r=l 

It is straightforward to check that in ©, the term 



(8) 
1 and 

(9) 



takes into account all integer vectors u which satisfy con- 
ditions (5-1) and (S-2), and the term T (M) (a?) takes into 
account all those which violate the condition (5-3). ■ 

In particular T^(x) = kx 2 , T^(x) = kx 2 + k(k - l)xiXz, 
and T^\x) = kx 2 + k(k — l)xix 3 + kx± + k{k — l)x 2 x i + 
\k(k — l)(fc — 2)x\x i . Also note that 



dfj( M )(a 

dx r 



dT^(x 



fc-i 



dx r 



forr=l,2,--- ,M. 



III. Growth Rate of the AWGN-Pseudoweight 
Distribution of the Regular LDPC Code ensemble 

For a positive integer n, we define a (j, /c)-regular LDPC 
code ensemble M. n as follows. The Tanner graph of an LDPC 
code from the ensemble consists of n variable nodes of degree 
j, and m = nj/k check nodes of degree k. The variable and 
check node sockets are connected by a permutation on the 
E = nj = mk edges of the graph, each permutation being 
equiprobable. 

The concept of degree-M assignment is defined next. This 
definition is a generalization of the definition of assignment 
in Q (the definition in [9| corresponds to that of a degree- 1 
assignment). 

Definition 7: A degree-M assignment is a labelling of 
the edges of the Tanner graph with numbers from the set 
{0, 1, 2, • • ■ , Af}. An assignment is said to have pseudoweight 
t = (ti t% ■ ■ ■ tjvf) if tr edges are labelled r for each 
r = 1, 2, • • • , M. An assignment is said to be M -check-valid 
if according to this labelling, every check node recognizes a 
valid local degree- M pseudocodeword. 

For any positive integer M , the growth rate of the degree- M 
AWGN-pseudoweight distribution of the (j, /c)-regular LDPC 
code ensemble sequence {M n } is defined by 



Gm(o) = lim - \ogE M 



(10) 



denotes the expectation operator over the en- 
and A r „ M ' ) denotes the number of degree-M 
pseudocodewords of AWGN-pseudoweight w of a randomly 



where 
semble M. r 



chosen LDPC code in the ensemble M. n . The limit in (TTOb 
assumes the inclusion of only those positive integers n for 
which an G Z and E» n [N an ] is positive (i.e., where the 
expression whose limit we seek is well defined). 

We next define a notion of asymptotic goodness of an LDPC 
code ensemble sequence. 

Definition 8: For each M > 1, let Gm{®) be the 
growth rate of the degree-Af pseudoweight distribution of 
an LDPC code ensemble sequence, and let a* M — inf{a > 
| Gj\f(a) > 0}. The ensemble sequence is said to be 
asymptotically good if and only if irdM>i{oi* M } > 0. 

The following theorem constitutes the main result of the paper. 

Theorem 1: The growth rate of the degree-M pseudoweight 
distribution of the (j, fc)-regular LDPC code ensemble se- 
quence {A^„} is given by 

M 

G M (a) = 3 -logB( M \x Q )-jJ2^ogxo,i ~ (j - l)h(q) 

(11) 

where x = (x ,i x , 2 • ■ • ajQ.Af), 1 = (li 0.2 • • • <?Af) and A 
are the solutions to the system of 2M + 1 equations in 2M+1 
unknowns^] 



OX 0:r 



(12) 



for each r = 1,2, • • ■ , M, 

Qr 



(i-i)iog 



1 

1 - E,=i is 



= X ( 2r sq s - . 



(13) 



s=l 



for each r = 1, 2, • • • , M, and 



(M \ M 
5> ?r -aY / r 2 qr = (14) 
r=l / r=l 

satisfying xo, r > and q r > for each r = 1, 2, • • • , M. 

Proof: Consider a degree-Af pseudocodeword 
z — (z% z% ■ ■ ■ z n ) with pseudoweight qn, where 
Q = ill Q2 • • • <Zj\/)- This pseudocodeword naturally 
induces a degree-Af assignment of pseudoweight jqn. 
Using (O, the AWGN-pseudoweight of z may be written as 
w(z) = an where 

2 



Er=l r <?7 



(15) 



Rearranging (fl5l ). and defining (7(g) appropriately, yields 
(TT~4b - The expected number of degree-Af pseudocodewords of 
pseudoweight qn is then 



3 Note that B( M )(a;) is given by Proposition [T] 



n 



P (M) (ia) 



(16) 



3 



where P^J id (a.) represents the probability that a randomly Therefore as n — > oo 
chosen degree-M assignment with pseudoweight an is M- 
check-valid. This probability is given by jg 



A4„ 



jn 
jqn 



(17) 



where Nc (a) 



denotes the number of M -check- valid 



degree- M assignments of pseudoweight an. The numerator 
of (T7\ may be written as □ 



#W(j Q ) = Coeff \(b^( 



■ x 



M 



We next make use of the following result from [11 Theorem 
2]: 

Lemma 1: Let R(x) denote a multivariate polynomial with 
nonnegative coefficients. For a fixed vector of positive rational 
numbers £ = (£i £2 4 • • £m)> consider the set of positive 
integers I such that £ r £ G Z for each r = 1, 2, • • ■ , M and 



Coeff ({R(x)Y,xl ie xl 2e 
is empty, or it has infinite cardinality; if t is one such I, then 
so is jt for every positive integer j. In the latter case, the 
following limit is well defined and exists: 



> 0. Then either this set 



lim — log Coeff 



{R{x)f ,xf l x\ 



\0gR(x Q ) - ^CrlogX , r (18) 



where x = (x ,i xq,2 ■ ■ ■ ^o,m) is the unique positive real 
solution to the system of equations 

dR(x ) 



d%0,r 

M. 



(19) 



2 



a; M M are related 




|lo gj B( M )(x ) 



• j g r logx 0jr - (j - l)/i(g) 



(21) 



The expected number of degree-M pseudocodewords with 
AWGN-pseudoweight an is equal to the sum of the numbers 
of degree-A/ pseudocodewords with pseudoweight q satisfying 
(HI), i.e. 



E 



M„ 



E E M n 
q ■ s(g)=o 



7YW(q)' 



Note that the asymptotic expression as n —> oo is dominated 
by that q satisfying (fT4b which maximizes the argument of 
the exponential function^. Therefore as n — > oo 



E 



at( m ) 



exp <j 71 ( max /(g) ) }> (22) 
v<? : ff(<j)=0 



where 



M 



/(g) = |logB( M )(aH))-jX?'-log*o,r-C7'-l)M9) ( 23 ) 

r— 1 

and 5(g) is given by ( TT~4-b . We solve this constrained optimiza- 
tion problem using Lagrange multipliers. At the maximum, we 
must have 

df(q) = x dg(q) 
dq r dq r 

for all r — 1,2, ••• , M, where A denotes the Lagrange 
multiplier. This yields 



for each r = 1, 2, • 

Applying this lemma by substituting R(x) = B^ M \x), I = 
m = nj/k and £> = kq r , we obtain that as n — > 00 

N ( c M \jq) - exp ^ logS^^o) - j logxo.rj | 

(20) 

where xq = (2:0,1 X0.2 • ■ ■ £"o,m) is the unique positive real 
solution to the system given by ( TTZt for each r = 1, 2, • • • , M. 
Note that (fT2l provides an implicit definition of :ro as a 
function of q. 

Using Stirling's formula, the multinomial coefficients 
in (Q~6| and (fTTI i may be approximated as n. — > 00 as 

exp{n/i(q)} ; . -c exp {ry'/i(g)} . 

gny 

4 Here we use the following result on multivariate generating functions. Let 
a u be the number of ways of obtaining an outcome u = (u\ 112 ■ ■ ■ ttjvf) G 
Z M in experiment .4, and let b v be the number of ways of obtaining an 
outcome v = (vi V2 ■ ■ ■ vm) £ m experiment B. Also let c w 

be the number of ways of obtaining an outcome (u, v) in the combined 
experiment (A, B) such that u + v = w. Denoting x = (x± X2 ■■ ■ ijm), 
the generating functions A(x) = a u x i 1 x 2 2 

J2 V bvx^x^ 2 ■ ■ ■ x\f and C(x) = J2w Cwx™ 1 x. 
by C(x) = A(x)B(x) 



1 



^ dB^jxp) dx , s 



v ' S — 1 



M 



<7s 9a;o, s 



log X0,i 



which is equivalent to 

M 



E 



<9.r 



0,s 



1 



kB( M )(x ) dx 



(i-l)^M = A%M (24) 



dBM(x ) _q^ 

XQ,. 



jloga;o,r + (j - l)log 



1 



M 



A 2r E 



s<7 s — ar 



(25) 



The term in square brackets is equal to zero for each r = 
1, 2, • • • , M due to ( fT2l ; therefore this simplifies to (Q~3) for 
each r = 1,2, • • ■ ,M. ■ 

5 Observe that as n — ► 00, ^D t exp(nZt) — > exp(nmaxi{Zt}) 
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Fig. 1 . Growth rate of the degree- M AWGN-pseudoweight distribution for 
the (3, 6)-regular ensemble (M < 3). 



Fig. 2. Growth rate of the degree-Af AWGN-pseudoweight distribution for 
the (4, 8)-regular ensemble (M < 3). 



Note that for the case M — 1, the maximization in 
is trivial and therefore the solution may be obtained directly 
from (l23ll as 



(1 + x Q ) k + (1 - x ) k 



Gi(a) = J - log 



- ja log .T - (j -l)h(a) (26) 
where xq is the unique positive real solution to the equation 



Xq 



(27) 



Note that G\{a) is simply the growth rate of the weight 
distribution in this case, originally obtained in [1|. Also, this 
solution may be regarded as a special case of TheoremQ]where 
the solution for A via ( fTST l is redundant. 

IV. Examples and Discussion 

In this section the growth rates of the AWGN-pseudoweight 
of two example LDPC code ensembles are evaluated using the 
solution of Theorem [T] The growth rate curves for the (3, 6)- 
regular LDPC code ensemble and for the (4, 8)-regular LDPC 
code ensemble are shown in Figures Q] and [2] respectively. 
Note that < a\ < ot\ < for both ensembles. It 
is worthwhile to note some distictions between the present 
analysis and that of Corollary 50]. In J5] Corollary 50], it 
is proved that (j, /c)-regular ensembles with j > 3 have a ratio 
of minimum AWGN-pseudoweight to block length n which 
decreases to zero asymptotically as n — > oo. This result is not 
in conflict with the results of Figures Q] and |2] The detrimental 
pseudocodewords of J5] Corollary 50] are derived from the 
"canonical completion" [5 Definition 46] and, asymptotically, 
have AWGN-pseudoweight sublinear in the block length - 



therefore, these pseudocodewords do not appear in the present 
analysis. Also, note that the analysis of (5] Corollary 50] 
takes the limit M — ► oo prior to (or jointly with) the limit 
n — > oo, in contrast to the present analysis which takes the 
limit n — ► oo for finite M, Finally, the result of [5 Corollary 
50] is concerned with minimum AWGN-pseudoweight and not 
with the multiplicities of the corresponding pseudocodewords. 
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